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JOB  AIDS:  DESCRIPTIVE  AUTHORING  FLOWCHARTS  FOR  PHASE  III-DEVELOP  OF  THE 
INSTRUCTIONAL  SYSTEMS  DEVELOPMENT  MODEL 


BRIEF 


Requirement : 

To  develop  a  series  of  job  aids  for  the  activities  identified  in  the 
Instructional  Systems  Development  Model  (ISD,  TRADOC  Pamphlet  350-30). 


Procedure: 

A  series  of  job  aids  were  designed  and  developed  for  each  of  the  five 
phases  of  the  ISD  model:  ANALYZE,  DESIGN,  DEVELOP,  IMPLEMENT,  and  CONTROL. 
Each  job  aid  is  comprised  of  Descriptive  Authoring  Flowcharts  and  a  Job  Aid 
Manual  which  provide  specific  guidance,  examples,  and  references  necessary  to 
produce  the  product  specified  by  the  ISD  Block  it  covers. 


Utilization: 

These  job  aids  will  be  used  by  military  training  personnel  in  meeting  the 
requirements  of  the  ISD  model. 
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WHAT  ARE  JOB  AI VS? 


•  Job  Aids  are  intended  to  be  stand-alone,  step-by-step  procedural  guides  which 
we  hope  will  permit  you  to  turn  out  quality  instructional  products  quickly 
and  easily.  We  also  hope  that  they  will  be  equally  useful  to  individuals  at  all 
experience  levels  of  the  instructional  systems  development  process. 

•  Job  Aids  are  intended  to  address  real  needs.  Prior  to  the  development  of  the 
Job  Aids,  instructional  technology  personnel  (individuals  like  yourself)  at  the 
U.S.  Army  Signal  Center  and  the  U.S.  Army  Engineer  School  were  surveyed  to 
determine  specific  ISD  needs— those  areas  in  which  they  had  the  greatest  need  for 
assistance  and  information.  Emphasis  was  placed  on  satisfying  these  needs  in  the 
development  of  the  Job  Aids. 

•  Job  Aids  use  the  same  classification  system  for  identifying  the  activities  that 
must  be  performed  in  instructional  systems  development  (IS D)  as  does 
TRADOC  Pamphlet  350-30  (Interservice  Procedures  for  Instructional  Systems 

noyalQpmantj 


WHAT  IS  THE  CLASSIFICATION  SYSTEM  USEV  IN  TPAVOC 
PAMPHLET  350-30  ANV  JOB  AIVS? 


•  TRADOC  Pamphlet  350-30  suggests  that  instructional  systems  development  be  con¬ 
ducted  in  five  phases: 

—  Analyze 
—  Design 
—  Develop 
—  Implement 
—  Control 

•  For  those  of  you  who  are  unfamiliar  with  TRADOC  Pamphlet  350-30  we  suggest 
you  read  the  brief  description  of  each  phase  of  the  ISD  process  as  shown  in 
Table  1.  In  the  TRADOC  Pamphlet  each  ISD  phase  is  divided  into  specific 
activities  called  ISD  blocks.  Table  2  shows  these  ISD  blocks  and  Table  3  shows 
the  outcome  of  each  block. 

•  Job  Aids  cover  the  activities  required  for  the  first  three  phases  of  the 
TRADOC  Pamphlet  (i.e.,  Analyze,  Design,  and  Develop  instructional  systems). 

The  Aids  cover  each  ISD  block  within  these  phases  except  for  ISD  Block  1.1, 
Analyze  Job. 


Table  1 


FIVE  PHASES  OF  INSTRUCTIONAL  SYSTEMS  DEVELOPMENT  (ISD) 

THE  FIVE  PHASES  ARE: 


PHASE  I 

ANALYZE 


Inputs,  processes,  and  outputs  in  Phase  I  are  all  based  on  job  information.  An  inventory  of  job 
tasks  is  compiled  and  divided  into  two  groups:  tasks  not  selected  for  instruction  and  tasks 
selected  for  instruction.  Performance  standards  for  tasks  selected  for  instruction  are  determined 
by  interview  or  observation  at  job  sites  and  verified  by  subject  matter  experts.  The  analysis  of 
existing  course  documentation  is  done  to  determine  if  all  or  portions  of  the  analysis  phase  and 
other  phases  have  already  been  done  by  someone  else  following  the  ISO  guidelines.  As  a  final 
analysis  phase  step,  the  list  of  tasks  selected  for  instruction  is  analyzed  for  the  most  suitable 
instructional  setting  for  each  task. 


PHASE  II 

DESIGN 


Beginning  with  Phase  II.  the  ISD  model  is  concerned  with  designing  instruction  using  the  job 
analysis  information  from  Phase  I.  The  first  step  is  the  conversion  of  each  task  selected  for 
training  into  a  terminal  learning  objective.  Each  terminal  learning  objective  is  then  analyzed  to 
determine  learning  objectives  and  learning  steps  necessary  for  mastery  of  the  terminal  learning 
objective.  Tests  are  designed  to  match  the  learning  objectives.  A  sample  of  students  is  tested  to 
insure  that  their  entry  behaviors  match  the  level  of  learning  analysis.  Finally,  a  sequence  of 
instruction  is  designed  for  the  learning  objectives. 


PHASE  lit 

DEVELOP 


The  instructional  development  phase  begins  with  the  classification  of  learning  objectives  by 
learning  category  so  as  to  identify  learning  guidelines  necessary  for  optimum  learning  to  take 
place.  Determining  how  instruction  is  to  be  packaged  and  presented  to  the  student  is 
accomplished  through  a  media  selection  process  which  takes  into  account  such  factors  as 
learning  category  and  guideline,  media  characteristics,  training  setting  criteria,  and  costs. 
Instructional  management  plans  are  developed  to  allocate  and  manage  all  resources  for 
conducting  instruction.  Instructional  materials  are  selected  or  developed  and  tried  out.  When 
materials  have  been  validated  on  the  basis  of  empirical  data  obtained  from  groups  of  typical 
students,  the  course  is  ready  for  implementation. 


PHASE  IV 

IMPLEMENT 


Staff  training  is  required  for  the  implementation  of  the  instructional  management  plan  and  the 
instruction.  Some  key  personnel  must  be  trained  to  be  managers  in  the  specified  management 
plan.  The  instructional  staff  must  be  trained  to  conduct  the  instruction  and  collect  evaluative 
data  on  all  of  the  instructional  comoonents.  At  the  completion  of  each  instructional  cycle, 
management  staff  should  be  able  t'  use  the  collected  information  to  improve  the  instructional 
system. 


phase  v 

CONTROL 


Evaluation  and  revision  of  instruction  are  carried  out  by  personnel  who  preferably  are  neither 
the  instructional  designers  nor  the  managers  of  the  course  under  study.  The  first  activity 
(internal  evaluation)  is  the  analysis  of  learner  performance  in  the  course  to  determine  instances 
of  deficient  or  irrelevant  instruction.  The  evaluation  team  then  suggests  solutions  tor  the 
problems.  In  the  external  evaluation,  personnel  assess  job  task  performance  on  the  job  to 
determine  the  actual  performance  of  course  graduates  and  other  job  incumbents.  All  collected 
data,  internal  end  extamal,  can  be  used  as  duality  control  on  instruction  and  as  input  to  any 
phase  of  the  system  for  revision. 
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Table  2 


PHASE  I 


PHASE  II 


PHASE  III 


PHASE  IV 


PHASE  V 


ISD  BLOCKS  IN  EACH  OF  THE  FIVE  ISO  PHASES 


THE  BLOCKS  IN  EACH  PHASE  ARE 


1.1 

ANALYZE 

JOB 

1.2 

k SELECT 

Y  TASKS/ 
FUNCTIONS 

1.3 

w  CONSTRUCT 

JOB 

~  PERFORMANCE 

measures 

1.4 

^analyze 

Y  existing 
COURSES 

IS 

^SELECT 

Y  INSTRUCTIONAL 
SETTING 

"W 

1.1 

►DEVELOP 

OBJECTIVES 

w  n-2 

m DEVELOP 
~  TESTS 

n.3 

W  DESCRIBE 

Gentry 

BEHAVIOR 

n.« 

W  DETERMINE 

Y  SEQUENCE  & 
STRUCTURE 

— 

mi 

SPECIE  Y 
LEARNING 
EVENTS/ 
ACTIVITIES 

m.2 

SPECIFY 

*  INSTRUCTION 

m management 

*  plan  & 

OELIVERY 

SYSTEM 

m.3 

W  review/select 
Y  existing 
materials 

.  m  4 

DEVELOP 

P  INSTRUCTION 

-  m  5 
^VALIDATE 
~  INSTRUCTION 

nr  i 

implement 
►  instructional 
management 

PLAN 


nr  2 

►  conduct 

INSTRUCTION 


Si 

. CONOUCT 
INTERNAL 
EVALUATION 


S.2 

.CONDUCT 

f  external 
evaluation 


S3 

►  REVISE 
SYSTEM 
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Table  3 


OUTCOMES  OF  ISO  BLOCKS 

THE  OUTCOMES  OF  THE  BLOCKS  ARE: 

.1 . . .  a  list  of  tasks  performed  in  a  particular  job. 

.2.  •  -  a  list  of  tasks  selected  for  training. 

.3-  -  ■  a  job  performance  measure  for  each  task  selected  for  instruction. 

.4. . .  an  analysis  of  the  job  analysis,  task  selection,  and  performance  measure 
construction  for  any  existing  instruction  to  determine  if  these  courses  are 
usable  in  whole  or  in  part 

.5-  -  -  selection  of  the  instructional  setting  for  task  selected  for  instruction. 


,1  . .  .  a  learning  objective  for  and  a  learning  analysis  of  each  task  selected  for 
instruction. 

.2  ■  ■  ■  test  items  to  measure  each  learning  objective. 

.3. . .  a  test  of  entry  behaviors  to  see  if  the  original  assumptions  were  correct. 

.4 . .  -  the  sequencing  of  all  dependent  tasks. 

.1  . .  .  the  classification  of  learning  objectives  by  learning  category  and  the 
identification  of  appropriate  learning  guidelines. 

.2  .  -  .  the  media  selections  for  instructional  development  and  the  instructional 
management  plan  for  conducting  the  instruction. 

,3.  •  •  the  analysis  of  packages  of  any  existing  instruction  that  meets  the  given 
learning  objectives. 

.4.  .  .  the  development  of  instruction  for  all  learning  objectives  where  existing 
materials  are  not  available. 

.5.  .  field  tested  and  revised  instructional  materials. 

.1  .  .  .  documents  containing  information  on  time,  space,  student  and  instructional 
resources,  and  staff  trained  to  conduct  the  instruction. 

.2-  •  •  a  completed  cycle  of  instruction  with  information  needed  to  improve  it  for 
the  succeeding  cycle. 


.1 .  .  .  data  on  instructional  effectiveness. 

,2  data  on  job  performance  in  the  field. 

.3  instructional  system  revised  on  basis  of  empirical  data. 
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CUHAT  SOURCES  OF  INFORMATION  (HERE  USED  IN  THE 
DEVELOPMENT  OF  JOB  AIDS? 

•  Job  Aids  are  not  just  a  re-hash  of  TRADOC  Pamphlet  350-30.  We  use  the 
same  classification  system  for  ISD  phases  and  the  blocks  within  the  phases 

as  does  the  TRADOC  Pamphlet.  However,  the  guidance  and  information  provided 
in  the  Job  Aids  come  from  a  variety  of  sources,  the  TRADOC  Pamphlet  being 
only  one  such  source.  We  have  gathered  information  from  any  source  that  we 
could  locate.  If  the  information  was  judged  to  be  good  it  was  included  in  the 
Job  Aids.  In  some  instances  the  information  in  the  Job  Aid  is  based  solely  on  the 
educational  technology  experience  of  the  project  staff. 

•  It  is  not  within  the  scope  of  this  Introduction  to  list  all  sources  of  information 
examined  or  used  in  the  development  of  the  Job  Aids.  However,  in  addition 
to  TRADOC  Pamphlet  350-30  examples  of  other  sources  of  information  would 
include  the  following  types: 

—  TRADOC  Circulars 

—  DA  Pamphlets 

—  Printed  Guidance  prepared  by  TRADOC  Schools  (e.g.,  U.S.  Army 
Signal  Center) 

—  Army  Research  Institute  Documents 
—  HumRRO  publications 
—  Other  military  and  civilian  agencies 
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WHAT  JOB  AIPS  ARE  PRESENTLY  AVAILABLE  ANV  WHAT  VO 
THEY  CONSIST  OF? 

•  There  are  thirteen  Job  Aids  presently  available.  Each  Job  Aid  is  comprised 
of  two  documents.  A  brief  description  of  each  is  provided  below:  (A 
complete  description  of  how  to  use  each  is  given  on  the  pages  that  follow.) 

—  Descriptive  Authoring  Flowcharts.  The  Descriptive  Authoring  Flowcharts  (usually 
referred  to  as  Flowchart  Manuals)  are  the  primary  documents  used  in  the 
Job  Aids.  They  direct  the  user  to  specific  guidance,  examples  and  references 
provided  in  the  Job  Aid  Manuals. 

—  Job  Aid  Manuals.  As  stated  above,  the  Job  Aid  Manuals  provide  the  specific 
guidance,  examples  and  references  necessary  to  produce  the  product  specified 
by  the  ISD  Block  they  cover.  In  addition,  each  Job  Aid  Manual  contains  one 
or  more  Worksheets  to  use  in  the  development  of  the  product. 

•  Another  important  part  of  the  Job  Aids  package  is  of  course  the  document 
you  are  presently  reading.  Introduction  to  the  Use  of  Job  Aids  and  Job 
Aid  Resource  Manual. 

•  The  specific  Job  Aids  available  are:  (Flowchart  Manual  and  Job  Aids  Manual 
for  each). 

—  Job  Aid  for  Selecting  Tasks  for  Training  (ISD  1.2) 

—  Job  Aid  for  Conducting  Task  Analysis  (ISD  1.3) 

—  Job  Aid  for  Analyzing  Existing  Courses  (ISD  1.4) 

—  Job  Aid  for  Selecting  Instructional  Settings  (ISD  1.5) 

—  Job  Aid  for  Developing  Objectives  (ISD  II.l) 

—  Job  Aid  for  Developing  Tests  (ISD  II. 2) 

—  Job  Aid  for  Describing  Entry  Behavior  (ISD  II .3) 

—  Job  Aid  for  Determining  Sequence  and  Structure  (ISD  II.4) 

—  Job  Aid  for  Specifying  Learning  Events  and  Activities  (ISD  III.l) 

—  Job  Aid  for  Specifying  Instructional  Management  Plan  and  Delivery 
System  (ISD  HI.2) 

—  Job  Aid  for  Review  and  Selection  of  Existing  Materials  (ISD  III.3) 

—  Job  Aid  for  Developing  Instruction  (ISD  III.4) 

—  Job  Aid  for  Validating  Instruction  (ISD  III.5) 
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WHAT  ARE  THE  MAIN  PARTS  OF  THE  FLOWCHART  MANUAL? 

.  Scan  through  a  few  pages  of  your  Flowchart  Manual.  Observe  the  following: 

—  Flowchart  symbols  used 

—  Instructions  or  questions  within  the  flowchart  symbols 
—  Supplemental  information  opposite  most  of  the  flowchart  symbols 
-  Flowchart  block  and  page  numbering  system 

«  For  a  complete  description  of  each  of  the  main  parts  of  the  Flowchart  Manual 
see  the  pages  that  follow. 
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WHAT  FLOWCHART  SYMBOLS  ARE  USEV  IW  THE  FLOWCHART  MANUAL? 


•  Flowchart  Symbols 

—  Only  five  symbols  are  used  in  the  Flowchart  Manual.  These  symbols  and  the 
instructions  within  them  act  as  a  road  map  to  lead  you  step-by-step  through 
the  process  of  developing  your  particular  product.  We  believe  that  after  you 
have  gotten  used  to  using  the  Flowchart  Manual  you  will  find  it  a  very  useful 
control  document.  The  five  symbols  used  are  as  follows: 


CUD 


Start-Stop  Symbol  —  Indicates  either  the  start  or  stop 
of  the  activities  called  for  in  the 
Flowchart  Manual. 


Decision  Symbol  —  Indicates  that  you  must  make  a 
decision  at  this  point  which  will 
determine  the  path  that  you  take 
thru  the  Flowchart  Manual. 


Manual  Symbol  —  Indicates  that  you  are  to  refer  to 
the  Job  Aid  Manual  for  specific 
additional  guidance  or  instruction 
shown  in  the  symbol. 


Rectangle  Symbol  —  Indicates  an  activity  that  must  be 
performed  but  does  not  require 
specific  additional  guidance  or 
instruction  in  the  Job  Aid  Manual. 
(In  some  cases  the  user  is  given 
the  option  of  going  to  the  Job 
Aid  Manual  to  see  a  completed 
example  of  the  activity  called  for 
in  the  rectangle  symbol). 


Go  To  Symbol  —  Indicates  a  branch  to  some  other 
flowchart  block.  The  branch  will 
either  be  to  a  previously  encountered 
block  or  will  jump  you  over  blocks 
that  can  be  omitted. 


WHAT  INSTRUCTION  IS  PROVWEV  WITHIN  THE  FLOWCHART 
SYMBOLS? 

•  Each  flowchart  symbol  except  the  Decision  Symbol  contains  a  brief  statement 
of  the  activity  that  you  are  to  perform.  If  this  activity  requires  the  completion 
of  part  of  a  Worksheet  the  specific  part  of  the  Worksheet  will  be  identified 
(remember,  each  Job  Aid  includes  one  or  more  Worksheets).  Decision  blocks 
always  contain  a  question  that  can  be  answered  with  a  yes  or  no  answer.  The 
branch  you  take  after  the  decision  block  will  depend  upon  your  answer. 


WHAT  IS  THE  PURPOSE  OF  THE  SUPPLEMENTAL  INFORMATION 
PROVIDED  IN  THE  FLOWCHART  MANUAL? 

•  The  supplemental  information  that  is  located  beside  most  of  the  flowchart  symbols 

serves  the  following  purposes: 

—  Provides  a  more  complete  description  of  the  steps  or  activities  that  must  be 
performed  in  the  ISD  Block  you  are  working  in  than  does  the  flowchart  itself. 

—  Refers  you  to  specific  pages  within  the  Job  Aid  Manual  for  specific  guidance, 
examples  and  references  needed  for  completing  the  activity  called  for  in  the 
flowchart  block.  (This  is  associated  with  the  Manual  symbol.) 

'  —  For  some  flowchart  blocks  (rectangle  symbol)  examples  of  the  completed  activity 
are  shown  in  the  Job  Aid  Manual.  The  supplemental  information  indicates  the 
specific  page  in  the  Job  Aid  Manual  containing  the  example.  However,  the  user 
has  the  option  of  going  to  the  Job  Aid  Manual  to  see  the  example.  (The  Manual 
symbol,  on  the  other  hand,  requires  the  user  to  go  to  the  Job  Aid  Manual.) 

—  Acts  as  an  executive  summary  which  will  allow  commanders  and  supervisors  to 
obtain  a  picture  of  the  activities  required  by  the  Job  Aid  without  reading  the 
entire  Job  Aid  Manual. 


WHAT  IS  THE  FLOWCHART  BLOCK  AND  PAGE  NUMBERING  SVSTEM? 

•  The  flowchart  block  and  page  numbering  system  is  as  follows: 

—  Flowchart  blocks  are  numbered  so  that  they  can  be  easily  referred  to. 

—  The  page  numbers  in  each  of  the  13  Flowchart  Manuals  are  preceded  by  an 
identifying  letter  unique  to  a  specific  ISD  Block.  (E.g.,  The  Flowchart  Manual 
pages  for  ISD  Block  1.2  go  from  A-l  to  A-15  whereas  for  ISD  Block  1.3  the 
Flowchart  Manual  pages  go  from  B-l  to  B-15.)  This  same  page  numbering  system 
is  also  used  in  the  Job  Aid  Manuals. 
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HOW  VO  I  USE  THE  JOB  A IV  MANUAL  AMP  WHAT  ARE  THE 
MAIN  PARTS  OF  IT? 

•  It  is  unlikely  that  you  will  need  to  refer  to  every  page  in  the  Job  Aid  Manual. 

As  previously  stated,  the  Job  Aid  Manuals  are  used  as  supplements  to  the  Flow¬ 
chart  Manuals  that  direct  you  to  specific  pages  within  the  Job  Aid  Manuals. 

Therefore,  DO  NOT  ATTEMPT  TO  USE  THE  JOB  AID  MANUALS  INDEPENDENTLY 
OF  THE  FLOWCHART  MANUALS. 

•  Scan  through  a  few  pages  of  your  Job  Aid  Manual.  Observe  the  following: 

—  Partial  flowcharts  shown  at  the  top  of  pages 

—  Questions  written  in  script  that  appear  on  most  pages 
—  Completed,  or  partially  completed  examples  of  Worksheets 


WHAT  IS  THE  PURPOSE  OF  THE  PARTIAL  FLOWCHARTS  AT  THE 
TOP  OF  SOME  PAGES  OF  THE  JOB  AIV  MANUAL? 

•  When  you  are  referred  to  the  Job  Aid  Manual  you  will  find  a  partial  flowchart  at 
the  top  of  the  Job  Aid  Manual  page.  You  are  to  remain  working  with  the  Job 
Aid  Manual  until  you  come  to  another  partial  flowchart.  Then  return  to  the 
Flowchart  Manual. 

•  The  partial  flowcharts  are  identical  to  those  shown  in  the  Flowchart  Manual. 
They  serve  as  an  additional  reminder  of  the  activity  being  dealt  with  at  the 
moment. 


WHAT  IS  THE  PURPOSE  OF  THE  QUESTIONS  WRITTEN  IN  SCRIPT 
THAT  APPEAR  ON  SOME  PAGES  OF  THE  JOB  AW  MANUAL? 


•  The  questions  written  in  script  are  our  way  of  telling  you  what  follows.  They 
highlight  such  things  as: 

—  The  purpose  of  performing  a  certain  activity 

—  How  the  activity  is  performed 

—  What  sources  are  available  for  performing  the  activity  and  how  good  they  are 

—  What  the  Worksheet  looks  like  after  the  activity  is  performed 


WHAT  IS  THE  PURPOSE  OF  THE  COMPLETE V  OR  PARTIALLY 
COMPLETEV  EXAMPLES  OF  WORKSHEETS? 

•  As  previously  stated,  every  Job  Aid  Manual  uses  one  or  more  Worksheets 
(located  in  a  pocket  at  the  back  of  the  Manual).  The  worksheets  permit  you  to 
produce  (and  document)  the  product  called  for  in  the  ISD  Block. 

•  Whenever  you  are  required  to  make  an  entry  on  a  Worksheet  an  example  of  that 
type  of  entry  will  be  shown  in  the  Job  Aid  Manual  and  will  usually  be  circled  so 
as  to  make  it  stand  out.  It  is  hoped  that  these  examples  will  give  you  a  clear  idea 
of  what  is  required  on  the  Worksheet. 
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WHAT  VOES  THIS  ALL  MEAN  ANV  WHAT  VO  I  VO  NOW? 


•  In  this  Introduction  we  have  attempted  to  explain  the  following: 

—  What  Job  Aids  are 

—  The  classification  system  (ISD  Phases  and  Blocks)  used  in  the  Job  Aids 

—  Sources  of  information  used  in  the  development  of  Job  Aids 

—  Job  Aids  presently  available 

—  A  description  of  Flowchart  Manuals 

—  A  description  of  Job  Aid  Manuals 

•  If  you  feel  that  you  have  an  adequate  understanding  of  the  above,  return  to  the 
Flowchart  Manual  now.  You  will  be  referred  to  specific  pages  in  the  Resource 
Manual  (the  remainder  of  this  document)  as  you  need  the  information  contained 
in  them.  Do  not  attempt  to  read  the  Resource  Manual  now. 

RETURN  TO  THE  FLOWCHART  MANUAL  NOW 
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JOB  AIDS  RESOURCE  MANUAL 


HOW  CAW  THE  RESOURCE  MANUAL  HELP  ME? 

The  purpose  of  this  resource  manual  is  to  assist  you  in  the  formation  of  a  data- 
based  system  for  decision  making  in  the  Analysis  Phase  of  the  Instructional  Systems 
Development  (ISD).  In  order  to  make  logical  and  objective  decisions  based  on  conditions 
and  needs  in  the  field,  you  must  collect,  organize,  analyze,  and  document  job  significant 
data  (information).  Such  data  includes  many  specifics  under  the  broad  categories  of 
job  background  data,  target  population  data,  and  critical  task  data.  The  specifications 
of  specific  data  requirements  and  sources  of  this  data  should  be  part  of  the  overall 
Job  Analysis  Plan. 
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WHAT  ARE  SOME  SOURCES  OF  JOB  SIGNIFICANT  VATA? 

There  are  many  sources  of  data  to  support  a  job  analysis. 

These  sources  include  such  things  as: 

•  Technical  Manuals 

•  Field  Manuals 

•  Army  Regulations 

•  Circulars  and  Phamplets 

•  Programs  of  Instruction 

•  Soldier’s  Manuals 

•  Previous  Task  Lists 

•  Documentation  from  the  Systems  Engineering  Era 

•  Reports  from  outside  agencies,  i.e..  Army  Research  Institute,  HumRRO, 
and  other  military  and  civilian  research  organizations 

•  Internal  Research  Reports 

•  Tables  of  Organization  and  Equipment  and  Tables  of  Distribution  and 
Allowances 

•  Civilian  Publications  (technical  journals  and  professional  publications) 

•  Equipment  Modification  Work  Orders 

•  CODAP  (Comprehensive  Occupational  Data  Analysis  Programs) 

•  Field  Surveys 

•  Panels  of  Experts 

WHICH  SOURCES  OF  VATA  ARE  INCLUVEV  IN  THE  RESOURCE 
MANUAL? 

Each  of  the  sources  listed  is  useful  for  fulfilling  specific  needs  in  the  Analysis  Phase 
of  ISD.  The  Job  Analysis  Plan  should  specify  exactly  which  items  of  data  will  be  needed 
and  the  recommended  source(s)  for  each  item.  In  this  way  all  the  data  can  be  accessed  and 
ready  for  use  as  soon  as  it  is  needed.  The  last  three  sources  on  the  list,  CODAP,  Field 
Surveys,  and  Consensus  Groups  or  Panels,  are  frequently  cited  in  the  Job  Aids  for 
specific  items  of  information.  How  to  use  these  sources  is  the  subject  of  this  manual. 


CODAP 
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WHAT  IS  COVAP? 


To  provide  personnel  managers  and  training  managers  with  the  reliable  job  data 
needed  for  job  and  task  analysis,  the  Deputy  Chief  of  Staff  for  Personnel  has  selected  the 
occupational  survey  questionnaire  for  data  collection  and  CODAP  (Comprehensive 
Occupational  Data  Analysis  Programs)  as  the  system  for  processing,  reporting,  and  anal¬ 
yzing  this  data.  The  combination  cf  questionnaire  and  CODAP  is  currently  being  used  by 
all  the  U.S.  Armed  Forces  to  support  their  occupational  survey  and  job  analysis  efforts. 
This  automated  data  system  provides  information  in  such  areas  as:  duties  and  tasks 
performed  by  job  and  duty  incumbents;  types  of  equipment,  tools,  and  vehicles  used 
and  maintained;  special  skills  and  knowledge  which  must  be  met  by  job  incumbents; 
quality  and  quantity  of  training  received  or  required;  physical  and  mental  demands;  and 
special  items  pertaining  to  personal  and  job  background  information,  work  environment, 
and  job  satisfaction. 
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WHEW  SHOULD  COVAP  REPORTS  BE  USED? 

Whenever  data  has  already  been  prepared  by  CODAP  it  should  be  used  in  preference 
to  school  conducted  surveys  in  order  to  prevent  duplication  of  effort.  CODAP  has  the 
capability  of  supplying  all  your  data  needs.  It  is  the  responsibility  of  each  Army  service 
school  to  initially  provide  the  Army  Occupational  Survey  Program  with  the  input  it  must 
have  to  supply  your  job  analysis  needs,  and  also  to  develop  a  job  analysis  plan  which 
allows  sufficient  time  to  access  the  necessary  data. 

Of  particular  use  in  job  analysis  are  Group  Summary  Reports.  The  Job  Aids 
suggest  that  you  obtain  these  reports  for  documenting  such  information  as:  tasks 
performed  in  each  duty  position  (ask  for  GPSUM6  report  for  your  MOS),  and  percentage 
of  soldiers  in  the  skill  level  performing  each  task  (ask  for  GPSUM  2).*  Given  sufficient 
lead  time  CODAP  can  also  make  up  special  reports  to  provide  ratings  on  task  selection 
factors  such  as,  time  to  train  OJE,  consequences  of  inadequate  performance,  and  proba¬ 
bility  of  emergency  performance  (ask  for  FACSUM  report). 


HOW  ARE  COVAP  REPORTS  OBTAINED? 


In  order  to  obtain  CODAP  data  you  should  first  check  with  your  supervisor  to  see  if 
the  information  you  need  has  already  been  accessed.  If  it  has  not,  write  to: 

Commander 

US  Army  Military  Personnel  Center 
ATTN.  DAPC-MSP-D 
2641  Eisenhower  Avenue 
Alexandria,  VA  22311 

or  call: 

325-9272/9493  (AUTOVON  221-9272/9493). 

Allow  at  least  three  weeks  for  the  reports  to  arrive  at  your  school.  The  necessary 
lead  time  could  be  much  longer  if  you  are  requesting  special  information  which  CODAP 
has  not  yet  collected.  It  is  recommended  that  you  obtain  the  two  official  guides  from 
MILPERCEN:  the  US  Army  Military  Occupational  Data  Bank,  and  the  US  Army  Occupa¬ 
tional  Survey  Program. 


*Keep  in  mind  that  these  percentages  are  baaed  on  the  peacetime  conditioni  in  which  soldiers  are 
presently  being  surveyed.  Adjustments  should  be  made  for  combat  tasks. 
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FIELD  SURVEYS 
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WHAT  IS  A  FORMAL  FI ELV  SURVEY? 


A  formal  field  survey  is  similar  to  the  type  of  questionnaire  survey  conducted  by 
the  Army  Occupational  Survey  Program,  only  it  is  conducted  by  instructional  development 
personnel  within  an  Army  service  school. 

The  use  of  questionnaires  permits  the  job  analysis  team  to  make  limited  contact  with 
large  numbers  of  personnel;  thus  large  amounts  of  information  can  be  collected  at  a  rela¬ 
tively  low  cost.  Questionnaires  can  be  mailed  to  personnel  who  are  asked  to  complete 
and  return  them,  or  they  can  be  administered  to  groups  of  job  incumbents  and/or  super¬ 
visors  by  local  personnel  who  have  the  responsibility  and  authority  to  make  sure  all 
questionnaires  are  completed  and  returned. 


WHEW  SHOULV  FORMAL  FI ELV  SURVEYS  BE  USED? 

Whenever  time  does  not  allow  you  to  access  information  from  the  Army  Occupa¬ 
tional  Survey  Program,  an  alternate  data  collection  method  may  be  used.  Formal  field 
surveys  are  suggested  as  an  alternate  data  source  in  the  ISD  Job  Aids.  Should  you  decide 
to  conduct  a  formal  field  survey  be  sure  to  obtain  permission  from  MILPERCEN  in 
accordance  with  the  guidelines  in  AR  600-46. 


HOW  IS  A  FI ELV  SURVEY  QUESTIONNAIRE  VES1GNEV? 

•  Types  of  Questionnaires 

There  are  two  types  of  questionnaires,  the  closed  form  and  the  open  form.  We 
suggest  using  the  closed  form,  which  contains  a  list  of  possible  items  to  be  selected  or 
blanks  to  be  filled  in  with  words  or  numbers.  (For  an  example  of  a  closed  form  ques¬ 
tionnaire,  see  Appendix  A.)  This  form  has  several  advantages  over  the  other  alternative, 
the  open  form.  It  is  likely  to  take  a  minimum  amount  of  time  to  fill  out,  thus  increasing 
the  chances  that  it  will  be  completed  and  returned.  The  process  of  tabulating  and  sum¬ 
marizing  responses  is  simpler  and  less  time  consuming  than  with  an  open  form  questionnaire. 
Machine  tabulation  and  computer  analysis  of  the  completed  forms  are  practical  when  a 
large  number  of  questionnaires  is  used. 

A  properly  designed  closed  form  questionnaire  is  difficult  to  prepare.  The  designer 
must  be  sure  to  include  all  possible  responses  expected  from  any  of  the  soldiers  who 
will  complete  the  questionnaire.  The  items  must  be  constructed  on  the  form  so  that 
they  clearly  communicate  to  the  user  exactly  what  the  designer  is  trying  to  ask.  The 
greatest  single  problem  with  research  methods  is  improperly  worded  questionnaires,  as  they 
produce  faulty  data.  If  you  intend  to  design  your  own  questionnaires  we  suggest  consult¬ 
ing  the  following  guides: 

Morsh,  J.E.  and  Archer,  W.B.  Procedural  guide  for  conducting  occupational 
surveys  in  the  United  States  Air  Force  (PRL-TR-67-11).  Lackland  Air 
Force  Base,  Texas:  Personnel  Research  Laboratory,  Aerospace  Medical 
Division,  Air  Force  Systems  Command,  September  1967. 

Jacobs,  T.O.  Developing  questionnaire  items:  how  to  do  it  well.  Human 
Resources  Research  Organization  (HumRRO),  300  North  Washington  Street, 
Alexandria,  Virginia  22314. 
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WHAT  SHOULV  BE  1NCLUVEV  OH  THE  (QUESTIONNAIRE? 


The  details  of  the  forms  you  use  will  be  determined  by: 

1.  how  you  will  tabulate  and  summarize  the  results,  and 

2.  what  information  you  wish  to  collect. 

How  you  will  tabulate  and  summarize  results  will  be  determined  by  whether  you 
have  available  a  computer  and  other  automated  data  handling  equipment  and  by  the 
number  of  people  surveyed.  To  determine  what  information  you  wish  to  collect,  you 
should  consider  the  total  data  requirement  for  the  training  development  process.  These 
data  requirements  should  be  predetermined  in  the  job  analysis  plan  so  that  as  much  infor¬ 
mation  as  possible  can  be  obtained  in  a  single  questionnaire  survey  effort. 

One  note  of  caution  about  the  design  of  your  questionnaire  is  that  you  should  keep 
the  questionnaire  as  short  as  practical.  In  general,  the  forms  should  be  designed  so  they 
can  be  completed  in  two  hours  or  less.  One  way  you  can  save  time  on  a  complex 
task  inventory  is  to  list  all  tasks  under  their  appropriate  duty  position  title.  This 
will  permit  the  soldier  to  rapidly  scan  groups  of  tasks  not  performed  and  then  pro¬ 
ceed  to  the  next  duty  position. 


WHAT  TVPE  OF  INSTRUCTIONS  FOR  COMPLETING  AND 
ADMINISTERING  THE  QUESTIONNAIRES  SHOULV  BE  PREPAREV? 

After  the  formal  field  survey  questionnaires  have  been  written,  the  instructions  for 
completing  and  administering  the  questionnaires  should  be  prepared.  These  instructions 
should  include: 


•  For  the  user  —  an  introduction  explaining  the  purpose  and 

importance  of  participating  in  the  field  survey. 

—  general  instructions  explaining  how  the  questionnaire 
is  to  be  completed. 

•  For  the  project  officer  —  general  instructions  regarding  responsibilities. 


(When  questionnaire  is  —  specific  instructions  for  administering  the  ques- 
not  self -administered)  tionnaire  in  a  controlled  environment. 


For  examples  of  these  types  of  instructions,  see  Appendix  B. 
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HOW  IS  A  SURl/EV  SAMPLE  SELECTEV? 

You  are  now  ready  to  select  organizations  and  individuals  to  provide  you  with  the 
needed  job  data.  The  complexity  of  the  MOS,  the  availability  and  quality  of  published 
sources  of  job  information,  and  the  number  of  people  in  the  particular  job  will  determine 
how  much  and  what  kinds  of  information  you  need  to  collect.  This  will  strongly 
influence  the  make-up  and  size  of  your  sample.  If  the  complexity  and  amount,  of  required 
data  are  great,  the  number  of  organizations  and  individuals  interviewed  will  increase.  As 
a  general  rule,  your  survey  sample  should  be  as  large  as  possible.  This  is  particularly  true 
if  you  do  not  have  personnel  available  with  the  responsibility  and  authority  to  assure  that 
most  of  your  questionnaires  will  be  completed.  You  should  make  an  attempt  to  obtain  a 
sample  that  represents  the  distribution  of  individuals  in  the  MOS  according  to  command 
and  skill  level.  Review  of  personnel  records,  either  by  personnel  employees,  members  of 
your  job  analysis  team,  or  your  field  representatives  who  will  conduct  the  survey  will  be 
required  to  obtain  data  upon  which  to  base  choices  for  your  survey. 

•  In  selecting  UNITS  for  sampling,  you  should  select  units  that: 

1.  have  at  least  a  small  number  of  job  holders  and  supervisors  who  do  the 
particular  job  to  be  analyzed.  Preferably,  you  should  choose  some  units 
that  have  a  relatively  small  number  of  job  holders,  and  some  that  have 
large  numbers. 

2.  are  geographically  and  environmentally  representative. 

•  In  selecting  INDIVIDUALS  within  the  units,  you  should  select  a  group  made  up 
of  individuals  who: 

1.  perform  and  supervise  the  job  being  analyzed 

2.  perform  with  average  satisfactory  proficiency 

3.  are  representative  in  terms  of  length  of  time  on  the  job 

4.  are  representative  in  terms  of  training. 


For  certain  types  of  information  you  will  also  want  to  choose  at  least  a  few  job  holders  or 
supervisors  who  are  acknowledged  experts  at  the  job. 


HOW  IS  A  QUESTIONNAIRE  SURVEy  CONVUCTEV? 


•  Trial  Run  (Validation  of  Instruments) 

Before  sending  out  the  total  number  of  questionnaires  you  intend  using,  you  may 
wish  to  send  out  a  small  number.  This  will  permit  you  to  check  the  initial  results  and 
possibly  make  some  changes  in  your  questionnaires  or  instructions.  Then  you  will  send 
out  what  you  hope  will  be  the  total  number  of  questionnaires  required. 


•  Group  Administration 

The  ideal  way  to  administer  questionnaires  is  group  administration.  Where  the 
local  responsible  official  and  his  assistants  schedule  the  administration  he  should  do 
the  following: 

—  Make  certain  that  only  eligible  individuals  are  seated  in  the  administration  area 
—  Read  the  administrative  instructions 

—  Provide  any  necessary  assistance  in  completing  the  questionnaires 
—  Return  the  completed  questionnaires  to  the  school 


•  Individual  Administration 

Often,  particularly  with  individuals  at  remote  stations,  group  administration  is 
impractical.  In  these  cases,  it  is  sometimes  effective  to  send  the  questionnaires  to  a 
responsible  officer  and  request  that  they  be  returned  by  a  reasonable  suspense  date. 
Careful  attention  should  be  paid  to  the  instructions  for  administration  or  self¬ 
administration.  If  your  command  has  no  authority  to  require  that  a  suspense  date 
be  met,  then  you  must  either  obtain  the  concurrence  of  a  command  with  that 
authority,  or  be  willing  to  accept  a  reduced  percentage  return. 


•  Return  of  Questionnaires 

How  much  confidence  can  you  have  in  the  validity  of  your  questionnaire  if  you 
get  less  than  a  100  percent  return?  Less  and  less  confidence  can  be  expected  with  each 
reduction  in  the  percentage  returned.  What  can  you  do  if  you  are  not  satisfied  with  the 
percentage  of  returns  of  the  questionnaires?  We  suggest  you  try  the  following: 

1)  Send  out  more  forms  to  different  people  and  hope  for  better  results. 

2)  Recontact  some  of  the  first  sample  and  try  to  encourage  them  to  return 
the  questionnaires. 

3)  Visit  a  random  sample  of  those  who  did  not  respond  and  compare  their 
forced  responses  with  the  voluntary  responses.  Then  you  and  your  super¬ 
visors  will  have  to  decide  how  much  chance  you  are  willing  to  take  that 
the  data  you  have  received  presents  a  sufficiently  accurate  picture  of  the 
job  as  it  really  exists. 
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WHAT  IS  A  PANEL  OF  EXPERTS? 


With  this  method  a  group  of  personnel,  selected  for  their  experience  and  knowledge 
of  the  job,  is  brought  together  to  confer  about  the  required  job  analysis  data.  Panels  may 
be  made  up  of  one  or  more  of  the  following  types  of  members: 

1)  Subject  Matter  Experts  (SMEs) 

These  are  personnel  found  at  your  school  who  are  acknowledged  experts 
in  the  tasks,  duty  positions  or  MOS  you  are  analyzing.  They  may  be 
found  among  instructors  or  ISD  personnel  who  hold  the  MOS.  SMEs 
may  or  may  not  have  had  recent  field  experience. 

2)  Job  Incumbents 

This  group  includes  those  who  are  presently  holding  the  jobs/performing 
the  tasks/  you  are  interested  in,  or  who  have  recently  held  the  jobs.  The 
more  recent  the  better.  More  than  three  years  away  from  the  field  would 
disqualify  a  potential  panel  member. 

3)  Job  Supervisors 

This  group  includes  those  who  are  presently  or  have  recently  (within  the 
past  three  years)  supervised  soldiers  in  the  jobs/tasks  you  are  interested  in. 

Job  incumbents  and  job  supervisors  may  be  found  on  the  post  where  your  school  is 
located  or  at  other  locations.  Check  the  TOEs  and  TO  As  to  find  out  where  personnel 
may  be  assigned.  While  personnel  assigned  to  your  post  tie  most  conveniently  assembled, 
they  may  not  be  completely  representative  of  job  incumbents/supervisors  serving  in  other 
locations.  Also,  they  probably  have  been  heavily  burdened  by  school  surveys,  panels,  etc., 
already  due  to  their  proximity  to  the  school.  Therefore,  personnel  from  other  locations 
may  have  to  be  used. 
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WHEN  IS  A  PANEL  USEV? 

Panels  of  experts  are  a  good  alternate  data  source  when: 

—  CODAP  is  not  available 

—  time  and  funds  are  inadequate  for  conducting  a  field  survey 

—  the  type  of  information  required  can  be  reliably  provided  by  a  small  group 


(MEN  ARE  SUBJECT  MATTER  EXPERTS  USEV? 

With  this  method,  a  group  of  highly  experienced  personnel  is  brought  together  to 
record  and  organize  the  required  job  analysis  data.  This  method  is  particularly  useful  in 
collecting  job  data  on  new  jobs  or  on  managerial  and  supervisory  jobs  where  many  of 
the  most  critical  behaviors  are  not  directly  observable.  Since  the  members  of  a  panel  of 
SMEs  are  experts  in  the  MOS  being  analyzed,  their  collective  effort  should  be  decisions 
about  the  requirements  of  the  job.  In  general,  their  greatest  effectiveness  is  in  evaluating 
and  making  decisions  about  job  data  that  have  been  collected  from  other  sources  by 
other  means. 


WHEN  ARE  RECENT  JOB  INCUMBENTS  ANVfOR  SUPERVISORS  USEV? 

With  this  method,  a  group  of  job  incumbents,  job  supervisors,  or  a  combination  of 
these,  is  brought  together  to  provide  information  about  their  jobs.  The  primary  function 
of  this  type  of  panel  is  to.  provide  information  about  their  jobs,  not  to  make  decisions. 
Another  name  for  this  type  of  panel  is  Consensus  Group. 


HOW  IS  A  PANEL  ASSEMBLEV? 

The  panel  is  a  relatively  inexpensive  and  easy  approach  to  collecting  data.  Three  to 
seven  persons  is  the  number  recommended  to  make  up  the  panel.  Whenever  possible,  you 
want  panel  members  to  be  representative  of  different  locations  and  types  of  units  in  the 
field.  While  many  experts  may  be  available  within  your  school  it  is  critical  that  their 
views  be  balanced  by  those  of  persons  serving  presently  or  recently  in  the  field.  If  all  of 
the  panel  members  come  from  schools,  there  may  be  a  tendency  for  the  outcome  to  reflect 
what  exists  in  training  rather  than  what  actually  exists  on  the  job. 
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Appendix  A 

EXAMPLE  OF  A  CLOSED  FORM  QUESTIONNAIRE 


-fctealAMd M  li  f  Yfalllill 


JOB  INVENTORY 

(DUTY  TASK  USTI 


971X0/933X0 


Page  7  of  a*  Pages 


1  Check  tasks  you  perform  now  (  vf 

2.  Add  any  tasks  you  do  now  which  are  not  listed 

3  In  the  "Time  Spent  *  column. /ate  checked  (^^tj 


tasks  on  time  spent  >n  your  present  10b 


Titnt  Spent  Scale 

t  -  VERY  MUCH  BELOW  AVERAGE  4  -  ABOUT  AVERAGE 

2  -  BELOW  AVERAGE  5  -  SLIGHTLY  ABOVE  AVERAGE 

3  -  SLIGHTLY  BELOW  AVERAGE  6  -  ABOVE  AVERAGE 


7  -  VERY  MUCH  ABOVE 
AVERAGE 


CHECK  IF 
DONE  IN 
PRESENT 
JOB 


C  FITTING  AND  MAINTAINING  LIFE  RAFTS  AN0  PRESERVERS 


TIME  SPENT 
DOING  THESE 
TASKS  IN 
PRESENT  JOB 


3.  Condemn  norvrsparstoie  lit*  reft*  or  life  preserver) 


4.  Fit  life 


*•  inject  or  weight  test  cartoon  dioxide  (CO?)  cylinder*  or  cartridges 


8  Make  entries  on  or  review  Life  Press  war  Data  forms  IAFTO  Form  466) 


10.  Mak a  entries  on  or  review  Life  Preserver  inspection  Date  Record  forms  IAFTO  Form  336) 


1 1 .  Make  entries  on  or  rswww  Life  Reft  Inspection  Record  forms  IAFTO  Form  337) 


12. 


•  entries  on  or  review  User  Certification  Label  forms  IAFTO  Form  27) 


IS.  Pack  life  rafts 


16.  Perform  functional  test*  of  life  pressmen 


17.  Perform  function#!  tests  of  life  reft* 


II.  Perform  inflation  rests  of  life  ( 


19.  Perform  vtftetwn  nets  of  life  reft* 


20.  Perform  minor  repain  to  life  preserver*  such 


ss  patch  mg  ripe,  teen,  or  h 


(Continued  nut  i 
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Appendix  B 


ADMINISTRATIVE  PROCEDURES 
FOR 

CLOSED  FORM  QUESTIONNAIRE 


Introduction  (for  user  of  questionnaire) 

General  Instructions  (for  user  of  questionnaire) 

General  Instructions  (for  project  officer) 

Specific  Instructions  for  Administering  Questionnaire 
(for  project  officer  when  questionnaire  is  administered 
in  a  controlled  environment. 


TO:  USER  OF  QUESTIONNAIRE 


INTRODUCTION 


TO  THE  NONCOMMISSIONED  OFFICER: 

This  questionnaire  is  part  of  a  field  survey  designed  to  identify  tasks  for  military 
police  training.  Its  specific  purpose  is  to  obtain  from  you,  the  Noncommissioned  Officer, 
information  on  task  criticality  and  frequency  of  performance.  Feedback  gained  from 
this  questionnaire  will  play  a  major  part  in  redesigning  the  Noncommissioned  Officer 
Advanced  Education  System.  The  ultimate  goal  is  to  design  training  so  that  it  reflects 
what  we  have  learned  from  you  in  the  field.  This  goal  is  possible  only  with  your  full 
cooperation.  Consider  each  task  listed  in  this  questionnaire  carefully  and  give  your  best 
response.  Your  contribution  is  essential  to  a  successful  survey. 
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TO:  USER  OF  QUESTIONNAIRE 


GENERAL  INSTRUCTIONS 

1.  Complete  this  survey  questionnaire  within  the  time  specified  by  your  unit  project 
officer  and  return  it  to  him  upon  completion. 

2.  Because  instructions  for  completing  each  part  of  this  survey  questionnaire  are 
different,  read  aU  instructions  carefully. 

3.  Part  II  requires  that  you  supply  biographical  information.  This  information  will  be 
used  to  correlate  feedback  received  from  the  field.  Print  all  answers  in  the  spaces 
provided  on  the  appropriate  survey  questionnaire  page. 

4.  In  the  upper  right  comer  of  each  page  of  Part  III,  Task  Inventory,  of  this  survey 
questionnaire  is  a  BOOKLET  NUMBER  block.  Immediately  to  the  left  of  this 
block  is  the  individual  booklet  number.  Print  the  individual  booklet  number  in  the 
BOOKLET  NUMBER  block  or.  each  page  of  the  Task  Inventory  as  demonstrated  in 
the  example. 


EXAMPLE: 


(000345) 


5.  Part  III,  Task  Inventory,  is  divided  into  nine  (9)  separate  sections  (Sections  I-IX). 
The  content  of  these  sections  concerns  tasks  you  may  perform  in  your  present  duty 
assignment.  You  are  asked  to  rate  each  task  in  accordance  with  three  criteria  - 
frequency  of  task  performance,  immediacy  of  task  performance,  and  importance  of 
task  to  mission  success. 


Base  all  selections  on  your  experience  in  your  present  duty  assignment. 

a.  Column  A  requires  that  you  rate  how  often  you  perform  each  task  on  a  scale 
from  one  to  four.  The  criterion  for  this  rating  is  the  frequency  of  task  per¬ 
formance.  Those  tasks  performed  most  frequently  will  normally  be  rated  four 
while  those  tasks  not  performed  at  all  will  be  rated  one. 
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b.  Column  B  requires  that  you  determine  how  soon  you  must  be  capable  of  per¬ 
forming  each  task  after  reporting  to  your  present  duty  assignment.  The  cri¬ 
terion  for  this  rating  is  the  immediacy  of  task  performance.  Of  the  four 
possible  responses,  select  the  one  most  nearly  describing  your  requirements. 
Select  response  number  four  for  those  tasks  which  you  must  be  capable  of 
performing  immediately  upon  reporting  for  duty.  Select  response  number  one 
for  those  tasks  which  you  never  perform. 

c.  Column  C  requires  that  you  describe,  in  your  opinion,  how  important  each 
task  is  to  mission  success.  The  criterion  for  this  rating  is  the  importance  of 
the  task  to  the  accomplishment  of  the  unit  mission.  Those  tasks  that,  in 
your  opinion,  are  most  important  to  mission  success  will  be  rated  four  while 
those  tasks  that  you  consider  least  important  will  be  rated  one. 

6.  After  selecting,  enter  your  responses  for  each  task,  using  either  a  pen  or  pencil,  in 
the  answer  portion  adjacent  to  the  appropriate  task  statement  as  demonstrated  in 
the  example. 

EXAMPLE:  The  task  PREPARE  CORRESPONDENCE,  if  rated  as  performed 

FREQUENTLY  in  Column  A,  identified  as  must  be  capable  of  performing 
IMMEDIATELY  in  Column  B,  and  determined  by  you  to  be  MOST 
IMPORTANT  in  Column  C,  would  be  entered  in  the  answer  portion,  as 
shown  below. 


PREPARE  CORRESPONDENCE  123412341234 

7.  After  each  section  of  Part  III,  Task  Inventory,  is  a  Write-In  Section.  These  write-in 
sections  are  provided  in  order  that  you  may  comment  on  each  task  inventory  section, 
or  list  any  task(s)  you  think  should  be  included  in  the  Task  Inventory.  These  sections 
also  allow  you  to  comment  on  those  tasks  that  you  find  are  the  most  difficult  for 
you  to  perform. 


TO:  PROJECT  OFFICER 


GENERAL  INSTRUCTIONS  FOR  PROJECT  OFFICER 


1.  General.  The  Military  Police  School  is  currently  involved  in  redesigning  basic 
military  police  training  to  produce  military  policemen  better  equipped  to  perform 
when  they  reach  the  unit.  The  emphasis  is  toward  training  replacements  in  tasks 
actually  being  performed  in  the  field.  The  questionnaires  in  this  packet  are  designed 
to  identify  those  tasks. 

The  care  with  which  you,  the  project  officer,  administer  the  questionnaires  will 
determine  the  accuracy  of  field  feedback  and,  consequently,  the  success  or  failure 
of  this  project. 

2.  Survey  Packet  Contents. 

a.  Questionnaire 

b.  Supervisor  Questionnaire 

c.  Project  Officer  Instructions 

d.  Answer  Sheets  for  Questionnaire 

e.  Pencils  for  use  on  answer  sheets. 

3.  Responsibilities. 

a.  Unit  Commander.  The  unit  commander  is  requested  to  appoint  a  project  officer 
and  to  monitor  administration  of  the  survey. 

b.  Project  Officer.  The  project  officer  is  responsible  for  the  control  and  handling 
of  questionnaires,  for  the  administration  of  the  questionnaires,  and  for  returning 
completed  and  unused  questionnaires  to  the  Military  Police  School. 

c.  Questionnaire  Administrator.  The  project  officer  may  appoint  someone  to 
administer  the  questionnaire,  if  necessary.  Normally,  however,  it  is  recom¬ 
mended  that  the  project  officer  administer  the  questionnaire  himself. 

4.  About  the  Questionnaires. 

a.  Questionnaire.  This  questionnaire  is  designed  to  identify  tasks  being  performed 
by  military  policemen  in  the  field  and  the  frequency  with  which  each  task 

is  performed. 

b.  Supervisor  Questionnaire.  The  supervisor  questionnaire  is  programmed  to  pro¬ 
vide  feedback  on  task  criticality,  probability  of  deficient  performance,  and  the 
frequency  with  which  each  task  is  performed. 


5.  Who  Takes  The  Questionnaire.  The  project  officer  is  responsible  for  selecting 
individuals  to  take  the  questionnaires  (respondents)  within  their  units.  Those 
selected  must  meet  the  requirements  listed  below: 

a.  The  questionnaire  respondent  must: 

(1)  Be  in  an  M.P.  duty  assignment  (actually  performing  M.P.  duties) 

(2)  Have  been  on  the  job  at  least  90  days 

b.  The  respondent  to  the  Supervisor  Questionnaire  must: 

(1)  Command  or  supervise  M.P.  personnel 

(2)  Have  been  in  a  command  or  supervisory  position  in  the  unit  for  90  days. 
(Assign  questionnaires  proportionately  among  officers  and  NCO’s.)  . 

6.  Questionnaire  Administration. 

a.  Questionnaire.  The  questionnaire  will  be  administered  in  a  controlled  environ¬ 
ment.  Persons  participating  in  the  survey  will  be  allowed  two  hours  to  complete 
the  questionnaire  and  will  turn  the  questionnaire  and  answer  sheets  in  to  the 
questionnaire  administrator  prior  to  leaving  the  survey  area.  Individual  question¬ 
naires  and  their  accompanying  answer  sheets  will  be  kept  together. 

See  attached  item  for  the  procedure  to  be  followed  in  administering  the 
questionnaire. 

b.  Supervisor  Questionn?  -e.  Supervisors  selected  as  respondents  for  this  ques¬ 
tionnaire  will  be  allowed  to  sign  for  the  questionnaire  and  take  it  with  them. 
They  will  complete  the  questionnaire  and  return  it  to  the  project  officer  within 
a  time  frame  he  specifies.  This  time  frame  must  be  compatible  with  the 
suspense  date  to  the  Military  Police  School. 

7.  Questionnaire  Handling.  Questionnaires  and  answer  sheets  become  FOR  OFFICIAL 
USE  ONLY  when  completed.  For  ease  of  accounting,  each  questionnaire  and  its 
accompanying  answer  sheets  are  numbered.  All  questionnaires  must  be  returned  to 
the  Military  Police  School  whether  they  are  used  or  not.  Instructions  for  returning 
the  questionnaires  to  the  Military  Police  School  are  contained  in  the  basic  letter. 

If  you  have  any  problems  or  questions,  contact  (NOTE:  Give  name  or  names, 
address,  and  telephone  number). 
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TO:  PROJECT  OFFICER  ADMINISTERING  QUESTIONNAIRE  IN  A  CONTROLLED 
ENVIRONMENT 


ADMINISTERING  THE  QUESTIONNAIRE 

A-l.  Preparation.  A  classroom  or  training  room  equipped  with  desks  will  provide  the 
most  ideal  site  for  administering  the  questionnaire.  Questionnaires,  answer  sheets, 
and  two  electrographic  pencils  should  be  issued  to  participants  after  everyone  who 
is  to  take  the  questionnaire  has  arrived.  This  ensures  that  everyone  starts  together. 

A-2.  Instructions.  The  questionnaire  administrator  will  present  the  following  instructions. 

a.  “Is  there  anyone  here  who  is  not  working  in  an  M.P.  duty  position?  Is  there 
anyone  here  who  has  not  been  assigned  to  their  present  duties  at  least  90  days? 
If  so,  please  leave  at  this  time." 

b.  “Will  everyone  at  this  time  please  read  the  first  page  in  the  questionnaire  which 
has  been  issued  to  you.” 

(Note  to  the  administrator:  It  must  be  emphasized  that  your  enthusiasm  for 
this  project  or  lack  of  it  will  be  contagious.  It  is  important  that  you  demon¬ 
strate  a  positive  attitude  to  the  participants.  Allow  tune  for  the  first  page  to 
be  read  and  underline  the  importance  of  the  questionnaire  with  the  following 
statement.) 

“I  would  like  to  stress  the  importance  of  this  questionnaire.  The  Military 
Police  School  wants  to  design  training  to  fit  the  job  in  the  field.  You  are 
the  only  people  who  can  tell  them  what  they  need  to  know.  Please  think 
through  each  question  and  give  your  best  answers.” 

c.  “Turn  to  Part  I,  Biographical  Information,  and  answer  questions  1-13. 

When  you  have  finished,  lay  your  pencil  on  the  desk  so  I  will  know  when 
to  proceed  to  the  next  step.” 

d.  “Now  read  the  instructions  found  in  Part  II.” 

(Note  to  the  administrator:  Allow  reasonable  time  for  everyone  to  finish  before 
moving  to  the  next  step.) 

“Are  there  any  questions?” 

e.  "As  you  read  in  the  instructions,  there  are  nine  answer  sheets  accompanying 
your  questionnaire.  Take  the  answer  sheets  and  number  them  one  through 
nine  to  correspond  to  the  first  nine  sections  in  Part  III  of  the  questionnaire. 

If  you  do  not  have  nine  answer  sheets,  raise  your  hand— I  have  extra  ones. 

Use  a  separate  answer  sheet  for  each  section.  Answer  only  the  number  of 
questions  listed  in  each  and  move  to  the  next  section  and  answer  sheet.  It 
is  not  necessary  to  write  your  name,  rank,  the  date,  or  course  at  the  top 

of  the  answer  sheet.  Also,  disregard  the  blocks  marked  score,  grade,  extra 
points,  and  social  security  number."  ~™""~ 


f.  “Because  of  the  size  of  this  survey,  these  answer  sheets  will  be  read  by 
machine.  You  must  use  the  special  pencils  provided  so  that  the  machine  can 
read  the  answers.  When  marking  your  answer,  take  care  to  fill  the  vertical 
rectangle  outlining  the  letter  as  shown  by  the  example  on  page  4  of  the 
instructions.  Also,  please  be  sure  not  to  make  any  stray  marks  on  the 
answer  sheets.  Finally,  do  not  fold  the  answer  sheets.” 

g.  “All  answers  must  be  based  on  your  experience  in  this  your  present  unit.  Do 
not  call  on  experience  in  previous  units.  This  means  that  if  you  do  not  per¬ 
form  a  particular  task  in  your  present  unit,  you  must  mark  ‘do  not  perform 
this  task’  on  your  answer  sheet.” 

h.  “You  may  begin  answering  Part  III.  Remember  Section  ten,  the  written 
section.  When  you  finish  answering  all  questions,  insert  your  answer 
sheets  into  the  questionnaire  and  turn  them  in  to  me.  You  may  leave 
when  you  are  finished.  Are  there  any  questions?” 

A-3.  Conclusion.  After  everyone  has  taken  the  questionnaire,  ensure  that  all  ques¬ 
tionnaires  and  answer  sheets  are  accounted  for.  Collect  the  pencils  provided  so 
that  they  may  be  returned  to  the  Military  Police  School  along  with  the  question¬ 
naires  and  answer  sheets. 
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JOB  AIDS: 

DESCRIPTIVE  AUTHORING  FLOWCHARTS 

ISD  1 1 1.1  Specify  Learning  Events/ Activities 


This  is  the  9th  in  a  series  of  ISD  Job  Aids  for  use  in  instructional  design  and 
development.  This  volume  will  direct  you  to  specific  guidance,  examples,  and  references 
provided  in  the  supplementary  manual  “Job  Aid  for  Specifying  Learning  Events /Activities 
ISD  III.l.”  If  you  do  not  have  the  supplementary  manual,  request  it  from  your  supervisor. 
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ISD  111.1  Specify  Learning  Events/ Activities 


•  List  of  critical  tasks  and  associated  Terminal 
Learning  Objectives  and  Learning  Objectives 
should  be  available  as  output  from  ISO  11.1 
Develop  Objectives. 

•  If  Learning  Objectives  are  not  available  for 
all  critical  tasks,  go  to  Job  Aids:  Descriptive 
Authoring  Flowcharts  ISO  11.1  Develop 
Objectives. 

•  When  Learning  Objectives  have  been  obtained 
return  to  Block  6. 


Select  First/Next  Critical 
Task  With  Associated 
TLOsand  LOs 


Guidance  for  Obtaining/ 
Preparing  Critical  Task 
List  and  Associated 
TLOs  and  LOs 


Obtain  First/Next 
Learning  Activities 
Recording  Sheet 
(LAR  Sheet) 


•  Learning  Objectives  for  each  critical  task  are  classified  by  learning  category  and 
sub-category.  Appropriate  learning  activities  are  then  specified  for  each  Learning 
Objective.  The  Learning  Activities  Recording  Sheets  (LAR)  are  used  to  record 
these  data. 

•  For  guidance  in  obtaining  LAR  Sheets,  see  Manual,  page  1-8. 
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•  Information  required  in  Section  I  of  the  LAR  Sheet  is: 

-  Name/Office  Symbol 

-  Date 

-  Course  under  development 

-  MOS/Skill  Level 

•  Example:  See  Manual,  page  1-9. 


Complete  Section  I  of 
LAR  Sheet 


1.4 


ISD  I f  1.1  Specify  Learning  Events/ Activities 


11 

Complete  Section  II  of 

LAR  Sheet 

12 

Identify  Ret 
Next  Learni 
[Col.  A,  Sec 
LAR  Sheet] 

ord  First/ 
ng  Objective 
tion  III, 

•  Information  required  in  Section  II  of  the  LAR  Sheet  is: 

-  Task  ID  No. 

-  Terminal  Learning  Objective  (Action  Statement  Only) 

•  Example:  See  Manual,  page  1-9. 


•  The  action  statement  for  each  learning  objective  associated  with  the  critical  task 
is  recorded  on  the  LAR  Sheet. 

•  For  further  guidance,  see  Manual,  page  1-10. 


No 


The  three  learning  categories  are: 

-  Mental 

-  Physical 

-  Attitudinal 


Yes 


15 


Oetermine/Record 
Learning  Category 
[Col.  B,  Section  III, 
LAR  Sheet] 
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Characteristics  of 
Learning  Categories 


•  To  determine  the  characteristics  of  each  of 
the  three  learning  categories  refer  to  the 
Manual,  page  1-11. 


•  One  of  the  following  three  learning  categories  is  recorded  in  Col.  B  of  the 
LAR  Sheet: 

-  MENTAL 

-  PHYSICAL 

-  ATTITUDINAL 

•  For  further  guidance  in  determining  and  recording  appropriate  learning 
category,  see  Manual,  page  1-12. 


1-5 
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28 


Record  Sub-Category 
l Col.  B,  Section  III, 
LAR  Sheetl 


29 


Determine/ Record 
Appropriate  Learning 
l Col.  C,  Section  III, 
LAR  Sheet) 


•  There  is  one  subcategory  under  the  ATTITUDINAL  Category.  It  is: 
-  attitude-learning 

•  For  examples  of  this  subcategory,  see  Manual,  page  1-34. 


•  Learning  Activities  necessary  for  teaching  the  learning  objectives  associated  with 
attitude-learning  are  prepared  and  recorded  on  the  LAR  Sheet. 

•  For  further  guidance  in  preparing  and  recording  appropriate  learning  activities, 
see  Manual,  page  1-36. 


ISD  1 1 1.1  Specify  Learning  Events/Activities 


During  the  instruction  activities  selection  process 
information  may  have  been  obtained  that  would  be 
useful  to  persons  who  performed  activities  that  fed 
into  this  step.  Similarly,  information  may  have 
been  obtained  that  would  be  useful  to  persons  who 
will  be  engaged  in  Instructional  Systems  Develop¬ 
ment  steps  that  follow  this  one. 


•  Comments  are  recorded  and  submitted  to 
appropriate  persons. 

•  For  further  guidance,  see  Manual,  page  1-41. 


JOB  AIDS: 

DESCRIPTIVE  AUTHORING  FLOWCHARTS 

ISO  III. 2  Specify  Instructional 
Management  Plan  and  Delivery  System 


This  is  the  10th  in  a  series  of  ISD  Job  Aids  for  use  in  instructional  design  and 
development.  This  volume  will  direct  you  to  specific  guidance,  examples,  and  references 
provided  in  the  supplementary  manual  “Job  Aid  for  Specifying  Instructional  Management 
Plan  and  Delivery  System  ISD  III. 2.”  If  you  do  not  have  the  supplementary  manual, 
request  it  from  your  supervisor. 


ISD  1 11.2  Specify  Instructional  Management  Plan  and  Delivery  System 


ISO  III. 2  Specify  Instructional  Management  Plan  and  Delivery  System 


•  Identifying  information  includes: 

-  MOS  -  Date 

-  Skill  level  -  Task  I.D.  number  located  on  Learning 

-  Course  title  -  Instructional  settings  Activities  Recording  Sheet 

-  Name/Office  Symbol 

•  For  example,  see  Manual,  page  J-12. 


•  For  further  information  and  guidance,  see  Manual,  page  J-13. 


•  For  further  information  and  guidance,  see  Manual,  page  J-15. 


•  The  matrix  is  located  for  the  learning  subcategory  which  has  an  X  in 
Section  III  B  for  this  objective  For  example,  if  there  is  an  X  in  the 
column  for  Gross  Motor  Skills,  then  that  is  the  matrix  to  be  used. 


J-5 


16 


Record  Appropriate 
"Training  Setting 
Criteria"  ( Learning 
Category  Matrix] 


17 


Record  Appropriate 
"Administrative  Criteria" 
[Learning  Category 
Matrix] 


•  A  light  check  mark  ( %/ )  is  made  on  the  matrix  to  indicate  the  criteria 
specified  by  the  instructional  setting  and  learning  activities  for  this  objective. 

•  For  further  guidance,  see  Manual,  pages  J-17  and  18. 


•  A  light  check  mark  ( V )  is  made  on  the  matrix  to  indicate  the  criteria 
specified  by  the  instructional  management  plan  for  this  objective. 

•  For  further  guidance,  see  Manual,  pages  J-19  and  20. 


All  matrices  include  Stimulus  Criteria  except: 

-  Subcategory  Identify  Objects  and  Symbols 
(Mental  Skills) 

-  Subcategory  Gross  Motor  Skills  (Physical  Skills) 

-  Subcategory  Attitude  Learning  (Attitude  Skills) 


•  A  light  check  mark  ( V  )  is  made  on  the 
matrix  to  indicate  the  criteria  specified  by  the 
learning  activities  for  this  objective. 

•  For  further  guidance,  see  Manual,  page  J-21. 
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ISO  111.2  Specify  Instructional  Management  Plan  and  Delivery  System 


J-7 


26 


Reject  as  a  Candidate 
Delivery  System 


Yes 


X" 

'Pre-recorded 
Opposite  Each 
"Stimulus  Criteria" 
\You  Checked. 


No 


For  example,  see  Manual,  page  J-31. 


For  example,  see  Manual,  page  J  33. 


ISD  !ll.2  Specify  Instructional  Management  Plan  and  Delivery  System 


For  example,  see  Manual,  page  J-35. 


Pre-recorded 
Opposite  Each 
^Complexity  Criteria 
sYou  Checke 


No 
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Record  the  Delivery 
System  on  DSP  Sheet 
[Section  III  (C), 

DSP  Sheet] 


•  For  guidance  in  recording  the  delivery  system  on  DSP  Sheet,  see  Manual, 
page  J-36. 


ISO  1 11.2  Specify  Instructional  Management  Plan  and  Delivery  System 


j-ii 
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Obtain  Supervisor  Review 
of  DSP  Sheets  and 
Select  Whole  Course 
Delivery  System 


•  For  guidance  in  determining  the  whole  course  delivery  system,  see  Manual, 
page  J-45. 
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Complete  Systems 
Management  Plan 


•  This  job  aid  does  not  include  guidance  for  completing  the  Systems  Management 
Plan  (SMP) 

•  For  information  about  what  is  included  in  the  SMP  and  where  to  obtain  guidance, 
see  Manual,  page  J-46. 


Record  Comments  on 
ISO  COORDINATION 
SHEET 


During  the  delivery  system  selection  process  infor¬ 
mation  may  have  been  obtained  that  would  be  useful 
to  persons  who  performed  activities  that  fed  into  this 
step.  Similarly,  information  may  have  been  obtained 
that  would  be  useful  to  persons  who  will  be  engaged 
in  Instructional  Systems  Development  steps  that 
follow  this  one. 


•  Comments  are  recorded  and  submitted  to 
appropriate  persons. 

•  For  further  guidance,  see  Manual,  page  J47. 


STOP 


> 


J.12 


JOB  AIDS: 

DESCRIPTIVE  AUTHORING  FLOWCHARTS 

ISD  1 1 1.3  Review/Select  Existing  Material 


This  is  the  11th  in  a  series  of  ISD  Job  Aids  for  use  in  instructional  design  and 
development.  This  volume  will  direct  you  to  specific  guidance,  examples,  and  references 
provided  in  the  supplementary  manual  “Job  Aid  for  Review  and  Selection  of  Existing 
Material  ISD  111.3."  If  you  do  not  have  the  supplementary  manual,  request  it  from  your 
supervisor. 
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ISD  1 1 1.3  Review/Select  Existing  Material 


Record  on  Top  of 
RR  Sheet  A: 

MOS  Code  Name 

Skill  Level  Date 

Instruction  Under  Develop. 


•  Types  of  instruction  may  include: 

-  a  complete  resident  course 

-  a  correspondence  course 

-  one  or  more  lessons 


-  one  or  more  modules 

-  a  TEC  lesson 

-  etc. 


•  For  further  guidance,  see  Manual,  page  K-1 1 . 


•  Reference  Review  Sheets  are  contained  in  pocket  at  the  back  of  Manual. 

•  For  example  of  what  completed  RR  Sheet  A  looks  like,  see  Manual, 
page  K-7  and  K-8. 


Example:  See  Manual,  page  K-1 2. 


Identify  and  Record  Name 
of  Existing  Army  Course(s) 
for  the  Tasks  You  Wish  to 
Train 

(Section  1,  RR  Sheet  A| 


•  At  the  present  time  these  tasks  may  be  trained  in  one  or  more  courses. 
If  so,  name(s)  of  Course(s)  is  recorded. 

•  For  example,  see  Manual,  page  K-1 3. 


•  RR  Sheet  A  includes  standard  Army  references  that  should  be  examined. 

•  Any  additional  sources  of  appropriate  Army  material  are  added  to  Section  1  of 
RR  Sheet  A. 

•  For  help  in  identifying  and  recording  ariditonal  sources  of  Army  material, 
see  Manual,  page  K-1 4. 


ISO  1 1 1.3  Review/Select  Existing  Material 


Obtain  DA  Pam  611-11 
DOD  Occupational 
Conversion  Table 


•  DA  Pam  611-11  provides  necessary  information  for  converting  Army  MOS's 
into  Air  Force,  Navy,  and  Marine  equivalents. 

•  DA  Pam  611-11  replaces  DA  Pam  611-12.  If  611-11  is  not  available, 

DA  Pam  61 1-12  can  be  used. 

•  For  further  explanation,  see  Manual,  page  K-16. 


No 


13 


Guidance  in  Using 
DA  Pam  611-11  - 
December,  1977  Version 


14 


Examine  DA  Pam  611-11 
to  Identify  Any  Service(s) 
With  Occupational 
Specialty  Similar  to 
Army  MOS 

- j - 


•  For  guidance  in  using  DA  Pam  611-11, 
see  technical  notes  at  beginning  of 
pamphlet. 


ISD  1 1 1.3  Review/Select  Existing  Material 
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Obtain  Pertinent 
Material  From  Course(s) 


Material(s)  may  consist  of  films,  tapes, 
textbooks,  graphs,  pictures,  over-head 
projections,  etc. 

For  guidance  in  obtaining  materials, 
see  Manual,  page  K-25. 


For  guidance  in  obtaining  references,  see  Manual,  page  K-26. 


No 
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24 


Record  Reason  for 
Unavailability 

(Record  Under  "Com¬ 
ments”,  RR  Sheet  A] 


The  reason  for  unavailability  is  recorded  so 
that  someone  else  working  on  this  block  in 
the  future  will  not  waste  time  looking  for 
references  that  are  no  longer  in  print,  etc. 

Example:  see  Manual,  page  K-27. 


Record  ON  RR  SHEET  B 
First/Next  Available 
Reference 

[Col.  1,  RR  Sheet  B] 


This  block  begins  the  process  of  identifying  materials  for  appropriateness  to  the 
instruction  being  developed. 

Work  is  now  being  done  on  RR  Sheet  B.  The  following  is  also  recorded: 

-  MOS  Code  -  Oate 

-  Skill  Level  -  Your  name 

Example:  see  Manual,  page  K-28. 


K-7 


I 


K-8 


ISD  111.3  Review/Select  Existing  Material 


Were 

All  Materials 
Available 


Scan  First/Next 
Available  Materials 
(Col.  lor  2.  RR  Sheet  B] 


Should  x 
the  Material 
be  Examined  in 

v  DeP'h  . 
\  1  / 


Record  Reason  for 
Unavailability 
[Record  Under  "Com¬ 
ments",  RR  Sheet  B] 


Example:  see  Manual,  page  K-33. 


•  This  block  begins  the  process  of  scanning  material  to  determine  if  it  should  be 
held  and  examined  in  depth  at  a  later  time. 

•  For  guidance,  see  Manual,  page  K-34. 


Enter  a  "N"  in  Col.  3. 
Record  Any  Appropriate 
Comments 
(Col.  3,  RR  Sheet  B) 


An  "N"  meaning  "No”  is  recorded  to 
designate  an  item  of  material  which  appears 
to  be  of  no  further  value  for  the  instruction 
being  developed. 

Example,  see  Manual,  page  K-35. 


36 


•  A  "Y"  meaning  "Yes '  is  recorded  to  designate  an 
item  of  material  that  initially  seems  appropriate 
for  inclusion  in  instruction  and  therefore  should 
be  held  for  further  evaluation. 

•  Example:  see  Manual,  page  K-35. 


- -  — 1  — - 

Enter  "Y"  in  Col.  3. 
Record  Any  Appropriate 
Comments. 

[Col.  3,  RR  Sheet  B] 


K.10 


ISD  1 1 1.3  Review/Select  Existing  Material 
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JOB  AIDS: 

DESCRIPTIVE  AUTHORING  FLOWCHARTS 

ISD  1 1 1 .4  Develop  Instruction 


This  is  the  12th  in  a  series  of  ISD  Job  Aids  for  use  in  instructional  design  and 
development.  This  volume  will  direct  you  to  specific  guidance,  examples,  and  references 
provided  in  the  supplementary  manual  “Job  Aid  for  Developing  Instruction  ISD  111.4." 
If  you  do  not  have  the  supplementary  manual,  request  it  from  your  supervisor. 
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START 


ISD  1 1 1.4  Develop  Instruction 


This  introduction  provides  the  user  with 
instruction  on  the  basic  structure  of  the 
Job  Aids  and  guidance  for  their  use. 


•  Refer  to  Introduction. 


Yes 


Yes 


Overview  of  Developing 
Instruction  Job  Aid 


Overview  includes: 

-  Goal 

-  Objectives 

-  Products 

-  Major  steps  in  process 

-  Worksheets  used 

-  Descriptive  flowchart 


•  For  detailed  overview,  see  Manual, 
page  L-6. 
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Yes 


•  In  order  to  develop  instruction  it  is  necessary  to  have 
the  following  inputs: 

-  from  ISD  Phase  II 

•  3  parts  learning  objectives 

•  corresponding  test  items 

•  group  letter  and  sequence  number  for  each  objective 

-  from  ISD  Phase  III 

•  learning  category  and  subcategory  for  each  objective 

•  corresponding  learning  activities 

•  management  plan  and  delivery  system 

•  selected  existing  instructional  materials 


Begin  Process  of 
Determining 
Resource  Requirements 


7  • 


_ 

Guidance  fo 
Preparing  Ol 
ISD  Phase  II 
ill. 2,  and  III 

Obtaining/ 
tputs  of 
and  111.1, 

.3 

The  outputs  of  the  4  blocks  at  ISD  Phase  II  and 
111.1,  III. 2,  and  111.3  should  be  available  from 
persons  responsible  for  those  activities. 

If  procedures  for  any  of  these  activities  were  not 
complete  Job  Aids;  Descriptive  Authoring  Flow¬ 
charts  may  be  referred  to  as  follows: 

-  Develop  Objectives,  pages  E-3  thru  E-13. 

-  Develop  Tests,  pages  F-3  thru  F-00. 

-  Sequence  and  Structure  Objectives,  pages  H-3 
thru  H-OQ. 

-  Learning  Categories/ Activities,  pages  1-3  thru  l-oo. 

-  Management  Plan/Delivery  System,  pages  J-3 
thru  J  12. 

-  Select  Existing  Materials,  pages  K-3  thru  K-11. 


•  This  block  begins  the  process  of  identifying: 

-  instructional  needs 

-  resources 

-  constraints 

•  Process  is  accomplished  in  blocks  9  thru  13. 


•  Instructional  needs  are  determined  on  the  basis  of  previous  analyses  and 
planning  which  took  place  in  ISO  Phase  II  and  III. 

•  For  further  information,  see  Manual,  page  L-1 1. 
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Study  Types  of 
Resources  and  Cost 
Factors  for  Developing 
Instruction 


•  For  types  of  instructional  resources  and  cost  factors,  see  Manual,  page  L-1 2. 


L-4 


ISD  1 1 1.4  Develop  Instruction 


L-5 


i 
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Select  First/Next 
Group  of  LOs  for 
Specified  Delivery 
System 


•  A  group  of  learning  objectives  for  a  particular  delivery  system  is  selected 


17 


Begin  Process  of 
Developing  First 
Draft 


•  This  block  begins  the  actual  development  of  instruction. 


Obtain  Instruction 
Development  (ID) 
Checklist 


•  Instruction  Development  Checklist  is  used  to  document  Steps  in 
preparation  of  first  draft  materials. 

•  For  guidance  in  obtaining  ID  checklist,  see  Manual,  page  L- 23. 


•  Identifying  information  includes: 

-  Your  name/Office  symbol 

-  Date 

-  Course/Module  under  development 

-  MOS/Skill  Level 
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ISD  1 1 1.4  Develop  Instruction 


L-7 


•  For  further  information,  see  Manual, 
page  L-25. 


•  For  further  information,  sep  Manual, 
page  L-26. 


•  For  further  information,  see  Manual, 
page  L-27. 


•  For  further  information,  see  Manual, 
page  L-28. 


'-•■V 


•  For  further  information,  see  Manual, 
page  L-29. 


•  For  further  information  and  guidance, 
see  Manual,  page  L-30. 


•  This  block  begins  the  actual  production  of 
the  audio-visual  lesson. 


•  Rough  sketches  or  stick  figures  are  called 
storyboards. 

•  For  further  information  and  guidance,  see 
Manual,  page  L-32. 


•  For  further  information  and  guidance,  see 
Manual,  page  1-34. 


Plan/Indicate/Check 
Composition  of  Visuals 
[ID  Checklist] 


Complete/Check  Visual 
Components  by 
Consultation  with 
Photographer/Artist 


Complete/Check  Audio 
Portion  of  Script 
[ID  Checklist] 


ISD  III. 4  Develop  Instruction 


For  further  information  and  guidance,  see 
Manual,  page  L-35. 


•  For  further  information  and  guidance,  see 
Manual,  page  L-36. 


•  For  further  information  and  guidance,  see 
Manual,  page  L-37. 


Indicate/Check 
Slide  Changes 
[ID  Checklist] 


•  For  further  information  and  guidance,  see 
Manual,  page  L  38. 


^/^Delivery^\_ 
System  for  This  Group' 
of  LQs  Written  > 
Text 


**'•**•»'* 


•  For  further  information  and  guidance,  see 
Manual,  page  L-3S. 


•  For  further  information  and  guidance,  see 
Manual,  page  L-43. 


•  For  further  information  and  guidance,  see 
Manual,  page  L-47. 


•  For  further  information  and  guidance,  see 
Manual,  page  L-49. 


•  For  further  information  and  guidance,  see 
Manual,  page  L-51. 


ISD  1 11.4  Develop  Instruction 


L-ll 
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Conduct  Individual 
Validation  Trials 


50 


Develop 
Student  Guide 


•  This  job  aid  does  not  cover  the  development  of  a  student  guide. 

•  TRADOC  Pam  350-30,  Block  1 11.4,  Develop  Instruction,  covers  this  topic. 


ISD  1 1 1.4  Develop  Instruction 
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JOB  AIDS: 

DESCRIPTIVE  AUTHORING  FLOWCHARTS 

ISD  II  1.5  Validating  Instruction 


This  is  the  13th  in  a  series  of  ISD  Job  Aids  for  use  in  instructional  design  and 
development.  This  volume  will  direct  you  to  specific  guidance,  examples,  and  references 
provided  in  the  supplementary  manual  “Job  Aid  for  Validating  Instruction  ISD  III. 5.” 

If  you  do  not  have  the  supplementary  manual,  request  it  from  your  supervisor. 
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ISD  1 1 1.5  Validating  Instruction 


START 


Haw  n. 

/^You  Read  the^\ 
Introduction  to  the  Use 
\af  Job  Aids 


•  This  introduction  provides  the  user  with 
instruction  on  the  basic  structure  of  the 
Job  Aids  and  guidance  for  their  use. 


Introduction  to  the  Use 
of  Job  Aids 


Refer  to  Introduction. 


/  Have  You  ^ 
Used  This  Job  Aid 
Before 

\  ?  / 


/  Want  to  ' 

See  an  Overview  of 
^  the  Job  Aid  . 
\  ?  / 


Overview  of  Validating 
Instruction  Job  Aid 


•  Overview  includes: 

-  Goal 

-  Objectives 

-  Products 

-  Major  steps  in  process 

-  Worksheets  used 

-  Descriptive  flowcharts 


For  detailed  overview,  see  Manual, 
page  M-4. 
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No 


Review  Validation 
Process 


•  Review  includes: 

-  Definition 

-  Necessity  for  validation 

-  Proper  time  to  validate 

-  Importance  of  feedback 

-  How  validation  helps  improve  instruction 

•  For  further  information,  see  Manual,  page 
M-9  thru  M-10. 


•  Instruction  Validation  Recording  Sheet  -  Individual  (IVR  Sheet  -  Indiv.)  is  used 
to  document  the  Individual  Trial(s)  Validation  process. 

•  For  guidance  in  obtaining  IVR  Sheet-lndiv,  see  Manual,  page  M-11. 


Complete  Section  I 
IVR  Sheet-lndiv. 
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Study  Guidelines  for 
Validation  Using 
Individual  Trial 
Evaluation(s) 


•  Information  included  in  Section  I  is  as  follows: 

-  Course  MOS  Code 

-  Skill  level 

-  Instruction  under  development 

-  Instruction  being  validated 

-  Individual  Validation  Trial  Number 

•  For  guidance  in  completing  Section  I  of  IVR  Sheet-lndiv.,  see  Manual,  page  M  12. 


•  Guidelines  explain  the  process  of,  and  procedures  used  in,  a  validation  trial  using 
a  single  trainee  as  a  subject. 

•  For  further  information,  see  Manual  page  M-14. 
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ISD  III. 5  Validating  Instruction 


•  This  block  begins  the  Individual  Validation  Trial(s)  process. 


•  The  name  and  organization  of  the  ISD  Individual(s)  conducting  the 
evaluation  is  recorded. 

•  For  example,  see  Manual,  page  M-16. 


•  Methods  used  in  validation  are: 

-  Tests  -  Interviews 

-  Questionnaires  -  Observation 

-  Attitude  Scales  -  Other  methods  specific  to  the  training  situation 

•  For  further  explanation,  see  Manual,  page  M-17. 


•  Trainees  who  are  representative  of  the  target  population  are  selected  as  subjects. 

•  For  further  guidance,  see  Manual,  page  M  20. 


•  Validation  Recording  Forms  include: 

-  Questionnaires 

-  Attitude  Scales 

-  Interview  Forms 

-  Observation  Forms 

•  For  guidance  in  preparing  Validation  Recording  Forms,  see  Manual,  page  M-21 . 


M-5 
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•  Methods  are  discussed  for  piesentation  of  instructional  material.  They  nclude: 

-  Who  should  present  the  material 

-  Location  (site)  for  presentation 

-  Amount  of  material  to  be  presented 

•  For  further  information,  see  Manual,  page  M-25. 


•  Forms  may  either  be  filled  out  by  the  trainee  (e.g.,  an  attitude  scale)  or  by  the 
person(s)  conducting  the  validation  (e.g.,  responses  to  an  interview). 


•  Forms  are  analyzed  for  patterns  of  responses  or  other  information  indicative  uf 
whether  or  not  revision  of  material  is  necessary. 


•  Following  are  examples  of  types  of  information  that  should  be  recorded: 

-  Patterns  of  correct  and  incorrect  responses. 

-  Indications  of  problems  areas  within  the  instructional  material. 

-  Trainees  comments,  where  applicable. 

-  etc. 

•  For  further  guidance,  see  Manual,  page  M-27. 


•  For  guidance  in  determining  if  an  additional  trainee  should  be  used  to 
evaluate  the  instructional  material,  see  Manual,  page  M  28. 
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ISD  III. 5  Validating  Instruction 


Revision  of  \  No 


26 


Obtain  Supervisor 
Approval  of  Revisions 


27 


Record  Date  Revisions 

Completed 

[Section  III, 

IVR  Sheet- 

-Indiv.) 

Determine  if  Additional 
INDIVIDUAL  Validation 
Trial  is  Needed 


•  For  example,  see  Manual,  page  M-31. 


•  When  revisions  resulting  from  the  previous  Individual  Validation  Trial  were 
extensive,  an  additional  Individual  Validation  Trial  may  be  desirable. 

•  For  information  and  guidance,  see  Manual,  page  M-32. 
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ISD  I II. 5  Validating  Instruction 

•  Guidelines  explain  the  process  and  procedures  used  in  a  validation  trial  in  which 
a  group  of  trainees  is  used  to  evaluate  the  instruction  material. 

•  For  guidelines,  see  Manual,  page  M-34. 


•  Instruction  Validation  Recording  Sheet-Group,  is  on  reverse  side  of 
IVR  Sheet-lndiv. 

•  For  example,  see  Manual,  page  M-35. 


•  This  block  begins  the  Group  Validation  Trial(s)  process. 


•  The  name  and  organization  of  the  individual(s)  conducting  the  evaluation  is 
recorded. 

•  For  example,  see  Manual,  page  M-37. 


•  The  validation  method(s)  used  in  Group  Validation  Trials  are  the  same  as  for 
Individual  Validation  Trials.  They  are: 

-  Tests  -  Interviews 

-  Questionnaires  -  Observation 

-  Attitude  Scales  -  Other  methods  specific  to  the  training  situations. 

•  For  example  of  how  to  record  validation  methods,  see  Manual,  page  M-38. 


M-9 


•  Groups  of  trainees  who  are  representative  of  the  target  population  are 
selected  as  subjects. 

•  For  further  guidance,  see  Manual,  page  M-39. 


•  Validation  Recording  Forms  for  Group  Validation  Trials  are  essentially 
the  same  as  for  Individual  Validation  Trials.  They  include: 

-  Questionnaires 

-  Attitude  Scales 

-  Interview  Forms 

-  Observation 

•  For  guidance  in  preparing  Validation  Recording  Forms,  see  Manual,  page  M-40. 


•  Methods  are  discussed  for  presentation  of  the  instructional  material  to  a 
group  of  trainees. 

•  For  further  information,  see  Manual,  page  M-42. 


•  Forms  may  be  filled  out  by  trainees  (attitude  scale),  instructor  (comments), 
validation  team  (interviews). 


•  Forms  are  analyzed  for  patterns  within  the  group  or  other  information 
indicative  of  whether  or  not  revision  of  material  is  necessary. 
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•  For  example,  see  Manual,  page  M-48. 


•  Revisions  will  normally  be  made  by  the  individual(s)  who  developed  the 
instruction  being  evaluated. 


•  For  example,  see  Manual,  page  M-51 . 


•  When  revisions  resulting  from  the  previous  Group  Validation  Trial  were 
extensive,  an  additional  Group  Validation  Trial  may  be  desirable. 

•  For  further  information  and  guidance,  see  Manual,  page  M-52. 
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